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Reduced-Latency Soft-In/Soft-Out Module 

Related Application 
This application claims the benefit of, and incorporates 
herein by reference, U.S. Provisional Patent Application No. 
60/201,583, filed May 3, 2000. 

Origin of Invention 
The research and development described herein were supported 
by the National Science Foundation under grant number NCR-CCR- 
972 6391. The US government may have certain rights in the 
claimed inventions . 

Field of the Invention 
The present application describes techniques for iterative 
detection or decoding of concatenated codes. More specifically, 
this application relates to computing the soft-inverse of a 
finite-state machine (i.e., the soft-in / soft-out or "SISO" 
module), for example, such as used in turbo decoders. 
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Background 

Due to the presence of noise on a communications channel, 
the signal received is not always identical to the signal 
transmitted. Channel coding, or equivalently, error correction 
5 coding, relates to techniques for increasing the probability that 
a receiver in a communications systems will be able to correctly 
detect the composition of the transmitted data stream. 
Typically, this is accomplished by encoding the signal to add 
ri redundancy before it is transmitted. This redundancy increases 
fSO the likelihood that the receiver will be able to correctly decode 
!u the encoded signal and recover the original data. 
^ Turbo coding, a relatively new but widely used channel 

"'-•3 

^ coding technique, has made signaling at power efficiencies close 
O to the theoretical limits possible. The features of a turbo code 
125 include parallel code concatenation, non-uniform interleaving, 
O and iterative decoding. Because turbo codes may substantially 
improve energy efficiency, they are attractive for use over 
channels that are power and/or interference limited. 

A turbo decoder may be used to decode the turbo code. The 
20 turbo decoder may include two soft-input/ soft-output (SISO) 
decoding modules that work together in an iterative fashion. 
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The SISO decoding module is the basic building block for 
established iterative detection techniques for a system having a 
network of finite state machines, or more generally, subsystems. 

Figs. 7A and 7B respectively show block diagrams of typical 
turbo encoder 10 and turbo decoder 11 arrangements. In this 
example, the turbo encoder 10 uses two separate encoders, RSC1 
and RSC2, each a Recursive Systematic Convolutional encoder. 
Each of the encoders RSC1 and RSC2 can be modeled as a finite 
state machine (FSM) having a certain number of states (typically, 
either four or eight for turbo encoders) and transitions 
therebetween. To encode a bit stream for transmission over a 
channel, uncoded data bits b k are input both to the first encoder 
RSC1 and an interleaver I. The interleaver I shuffles the input 
sequence b k to increase randomness and introduces the shuffled 
sequence a k to the second decoder RSC2 . The outputs of encoders 
RSC1 and RSC2, c k and d k respectively, are punctured and 
modulated by block 12 to produced encoded outputs x k (0) and 
x k (l), which are transmitted over a channel to the decoder 11. 

At the decoder 11, the encoded outputs are received as noisy 
inputs Zk(O) and z k (l) and are de-modulated and de-punctured by 
block 13, which is the soft-inverse of puncture and modulation 
block 12. The output of block 13, M[c k (0)], M[c k (l)] and 
M[d k (l)], is "soft" information - that is, guesses or beliefs 
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about the most likely sequence of information bits to have been 
transmitted in the coded sequences Ck(0), Ck(l) and dk(l), 
respectively. The decoding process continues by passing the 
received soft information M[c k (0)], M[c k (l)] to the first 
5 decoder, SIS01, which makes an estimate of the transmitted 
information to produce soft output M[bk] and passes it to 
interleaver I (which uses the same interleaving mapping as the 
interleaver I in the encoder 10) to generate M[ak] . The second 
O decoder, SIS02, uses M[a k ] and received soft information M[d k (l)] 
f|0 to re-estimate the information. This second estimation is looped 
ZJ back, via the soft inverse of the interleaver, I" 1 , to S1S01 
Jl where the estimation process starts again. The iterative process 
m continues until certain conditions are met, such as a certain 
f==f number of iterations are performed, at which point the final soft 
l-i5 estimates become "hard" outputs representing the transmitted 
O information . 

Each of the SISO decoder modules in the decoder 11 is the 
soft-inverse of its counterpart RSC encoder in the encoder 10. 
The conventional algorithm for computing the soft-inverse is 
2 0 known as the "forward-backward" algorithm such as described in G. 
David Forney, Jr., "The Forward-Backward Algorithm," Proceedings 
of the 34 th Allerton Conference on Communications, Control and 
Computing, pp. 432-446 (Oct. 1996) . In the forward-backward 
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algorithm, an estimate as to a value of a data bit is made by 
recursively computing the least cost path (using add-compare- 
select, or ACS, operations) forwards and backwards through the 
SISO' s "trellis" - essentially an unfolded state diagram showing 
all possible transitions between states in a FSM. Each path 
through the SISO's trellis has a corresponding cost, based on the 
received noisy inputs, representing a likelihood that the RSC 
took a particular path through its trellis when encoding the 
data. Typically, the lower a path's total cost, the higher the 
probability that the RSC made the corresponding transitions in 
encoding the data. In general, the forward and backward ACS 
recursions performed by a SISO can be computed either serially or 
in parallel. Performing the recursions in parallel, the faster 
of the two methods, yields an architecture with latency O(N), 
where N is the block size of the encoded data. As used herein, 
"latency" is the end-to-end delay for decoding a block of N bits. 

The present inventors recognized that, depending on the 
latency of other components in a decoder or other detection 
system, reducing the latency of a SISO could result in a 
significant improvement in the system's throughput (a measurement 
of the number of bits per second that a system architecture can 
process) . Consequently, the present inventors developed a tree- 
structured SISO that can provide reduced latency. 
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Summary 

Implementations of the tree-structured SISO may include 
various combinations of the following features, 
5 In one aspect, decoding an encoded signal (for example, a 

turbo encoded signal, a block encoded signal or the like) can be 
performed, e.g., in a wireless communications system, by 
demodulating the received encoded signal to produce soft 
H information, and iteratively processing the soft information with 
fjo one or more soft-in / soft-output (SISO) modules. At least one 
Z of the SISO modules uses a tree structure to compute forward and 
^ backward state metrics, for example, by performing recursive 
UJ marginalization-combining operations, which may in various 
O embodiments include min-sum operations, min*-sum operations 
C35 (where min* = min(x,y) - ln(l 4- e~ ,x " Yl )), sum-product operations, 
B and/or max-product operations. 

The encoded signal may comprise at least one of a turbo 
encoded signal, a block turbo encoded signal, a low density 
parity check coded signal, a product coded signal, a 
20 convolutional coded signal, a parallel concatenated convolutional 
coded signal, and/or a serial concatenated convolutional coded 
signal . 
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The iterative processing may be terminated upon occurrence 
of a predetermined condition, for example, the completion of a 
predetermined number of iterations. The iterative processing may 
include performing parallel prefix operation or parallel suffix 
operations, or both, on the soft information. Moreover, the 
iterative processing may include using soft output of a first 
SISO as soft input to another SISO, and/or may include performing 
marginalization-combining operations which form a semi-ring over 
the soft-information. 

The tree structure used by at least one SISO may be a tree 
structure that results in the SISO having a latency of O(log 2 N) , 
where N is a block size, a Brent-Kung tree, or a forward-backward 
tree, e.g., having a tree structure recursion that is bi- 
directional . 

Processing performed by at least one SISO may include tiling 
an observation interval into subintervals, and applying a minimum 
half-window SISO operation on each subinterval. 

In another aspect, a SISO module may include a plurality of 
fusion modules arranged into a tree structure and adapted to 
compute forward and backward state metrics. Each fusion module 
may be defined by the equation: 
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where C(k / m) is a matrix of minimum sequence metrics (MSM) of 
state pairs Sk and s m based on soft-inputs between Sk and s m . At 
least one of the fusion modules may compute forward and backward 
state metrics by performing recursive marginalization-combining 
operations . 

In another aspect, a SISO module may include one or more 
complete fusion modules (CFMs) for performing marginalization- 
combining operations in both a forward direction and a backward 
direction, one or more forward fusion modules (fFMs) for 
performing marginalization-combining operations only in the 
forward direction, and one or more backward fusion modules (bFMs) 
for performing marginalization-combining operations only in the 
backward direction. The one or more CFMs, fFMs, and bFMs are 
arranged into a tree structure (e.g., Brent-Kung tree, forward- 
backward tree) . An amount of the CFMs may be set to a minimum 
number needed to compute a soft-inverse. In general, fFMs and 
bFMs may be used in the tree structure in place of CFMs wherever 
possible . 

In another aspect, iterative detection may include receiving 
an input signal (e.g., a turbo encoded signal or a convolutional 
coded signal) corresponding to one or more outputs of a finite 
state machine (FSM) , and determining the soft inverse of the FSM 
by computing forward and backward state metrics of the received 
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input signal using a tree structure. The forward and backward 
state metrics may be computed by one or more SISO modules, for 
example, using a tree-structured set of marginalization-combining 
operations . 

5 Determining the soft inverse of the FSM may include 

iteratively processing soft information, for example, performing 
parallel prefix operation or parallel suffix operations, or both, 
on the soft information. Moreover, the iterative processing may 
[j include using soft output of a first SISO as soft input to 
fio another SISO. At least one SISO further may tile an observation 
interval into subintervals, and apply a minimum half -window SISO 
operation on each subinterval. 

In another aspect, a turbo decoder includes a demodulator 
^ adapted to receive as input a signal encoded by a FSM and to 
^5 produce soft information relating to the received signal, and at 
P least one SISO module in communication with the demodulator and 
adapted to compute a soft-inverse of the FSM using a tree 
structure. The tree structure may implement a combination of 
parallel prefix and parallel suffix operations. 
20 The turbo decoder may include at least two SISO modules in 

communication with each other. In that case, the SISO modules 
may iteratively exchange soft information estimates of the 
decoded signal. In any event, at least one SISO may compute the 
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soft-inverse of the FSM by computing forward and backward state 
metrics of the received signal. 

In another aspect, iterative detection may be performed by 
receiving an input signal corresponding to output from one or 
more block encoding modules, and determining the soft inverse of 
the one or more block encoding modules by computing forward and 
backward state metrics of the received input signal using a tree 
structure- The input signal may include a block turbo encoded 
signal, a low density parity check coded signal, and/or a product 
coded signal. 

Determining the soft inverse of the block encoding module 
may include iteratively processing soft information, for example, 
performing parallel prefix operation or parallel suffix 
operations, or both, on the soft information. 

In another aspect a block decoder may include a demodulator 
adapted to receive as input a signal encoded by a block encoding 
module and to produce soft information relating to the received 
signal, and at least one SISO module in communication with the 
demodulator and adapted to compute a soft-inverse of the block 
encoding module using a tree structure. The tree structure used 
may implement a combination of parallel prefix and parallel 
suffix operations. The block decoder may further include at 
least two SISO modules in communication with each other, wherein 



10 



PATENT 

ATTORNEY DOCKET NO: 06666-077001/USC-3027 

the SISO modules iteratively exchange soft information estimates 
of the decoded signal. In any event, at least one SISO may 
compute the soft-inverse of the block encoding module by 
computing forward and backward state metrics of the received 
5 signal. 

In another aspect, iterative detection may include receiving 
an input signal (e.g., a block error correction encoded signal, a 
block turbo encoded signal, a low density parity check coded 
signal, and/or a product coded signal) corresponding to one or 

0 more outputs of a module whose soft-inverse can be computed by 
running the forward-backward algorithm on a trellis 
representation of the module (e.g., a FSM or a block encoding 
module) , and determining the soft inverse of the module by 
computing forward and backward state metrics of the received 

5 input signal using a tree structure. 

One or more of the following advantages may be provided. The 
techniques and methods described here result in a tree-structure 
SISO module that can have a reduced latency as low as 0(lg N) 
[where N is the block size and "lg" denotes log2] in contrast to 

0 conventional SISOs performing forward-back recursions in 

parallel, which have latency 0(N). The decrease in latency comes 
primarily at a cost of chip area, with, in some cases, only a 
marginal increase in computational complexity. This tree- 
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structure SISO can be used to design a very high throughput turbo 
decoder, or more generally an iterative detector. Various sub- 
windowing and tiling schemes also can be used to further improve 
latency. 

5 These reduced-latency SISOs can be used in virtually any 

environment where it is desirable or necessary to run the 
forward-backward algorithm on a trellis. For example, the tree- 
SISO finds application in wireless communications and in many 
r« ? types of decoding (turbo decoding, block turbo decoding, 
JjO convolutional coding including both parallel concatenated 
^ convolutional codes and serial concatenated convolutional codes, 
y parity check coding including low density parity check (LDPC) 
W codes, product codes and more generally in iterative detection) . 
O The reduced-latency SISOs are particularly advantageous when 
□5 applied to decode FSMs having a relatively small number of 
O states, such as turbo code FSMs which typically have either 4 or 
8 states. 

The details of one or more embodiments are set forth in the 
accompanying drawings and the description below. Other features, 
20 objects, and advantages of the invention will be apparent from 
the description and drawings, and from the claims. 
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Drawing Descriptions 
Fig. 1 shows the C fusion process. 

Fig. 2 shows a fusion module array for combining the 
complete set of C matrices on [ko, ko + K] and [ko + K, ko + 2K] 
5 to obtain the complete set on [ko, ko + 2K] . 

Fig. 3 shows a tree-SISO architecture for N = 16. 
Fig. 4 shows a tiled sub-window scheme based on the forward- 
backward algorithm. 
P Fig. 5 shows a tiled sub-window approach with 4 tree-SISOs 

rSo of window size 4 for N = 16 to implement a d = 4 MHW SISO. 

Fig. 6 is a graph showing a simulation of a standard turbo 
,1 code for SISOs with various half-window sizes, N = 1024, and ten 
* sd! iterations . 

^ Figs. 7A and 7B show examples of a turbo encoder and a turbo 

-Is decoder, respectively. 

O Figs. 8A and 8B show a forward-backward tree-SISO (FBT-SISO) 

implementation . 

Fig. 9 shows an embodiment of a Brent-Kung Tree-SISO. 
Fig. 10 is a graph showing transistor count estimations for 
20 the Brent-Kung Tree-SISO approach of Fig. 9. 

Fig. 11 shows the trellis structure for the parity check for 
a standard Hamming (7,4) code. 
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Fig. 12 shows a tree structured representation of the 
Hamming code parity check, in which the f orward-backward-tree- 
SISO algorithm may be run on this tree with an inward (up) set of 
message passes to the node labeled V6, followed by an outward 
5 (down) set of message passes to produce the desired soft-out 
metrics on the coded bits. 

Fig. 13 shows an example of an LDPC decoder (overall code 
rate of 0.5) in which beliefs are passed from the broadcaster 
Pi nodes to the parity check nodes through a fixed permutation, and 
?%Q in which the parity check nodes can be implemented as a tree- 
structured SI SO . 

iy Detailed Description 

O The present inventors have developed a re-formulation of the 

CI 5 standard SISO computation using a combination of prefix and 
P suffix operations. This architecture - referred to as a Tree- 
SISO - is based on tree-structures for fast parallel prefix 
computations used in Very Large Scale Integration (VLSI) 
applications such as fast-adders. Details of the Tree-SISO and 
20 various alternative embodiments follow. 

Calculating the "soft-inverse" of a finite-state machine 
(FSM) is a key operation in many data detection/decoding 
algorithms. One of the more prevalent applications is iterative 
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decoding of concatenated codes, such as turbo codes as described 
in Berrou, et al., "Near shannon limit error-correcting coding 
and decoding: turbo-codes , " International Conference on 
Communications , (Geneva, Switzerland), pp. 1064-1070, May 1993; 
5 and Berrou, et al., "Near optimum error correcting coding and 
decoding: turbo-codes/' IEEE Trans. Commun., vol. 44, pp. 12 61- 
1271, October 1996. However the SISO (soft-in/soft-out) module 
is widely applicable in iterative and non-iterative receivers and 
p signal processing devices. The soft-outputs generated by a SISO 
r|0 may also be thresholded to obtain optimal hard decisions (e.g., 
?;% producing the same decisions as the Viterbi algorithm (G. D. 
J! Forney, "The Viterbi algorithm, " Proc. IEEE r vol. 61, pp. 2 68- 
- u 278, March 1973) or the Bahl algorithm (L. R. Bahl, J. Cocke, F. 

Jelinek, and J. Raviv, "Optimal decoding of linear codes for 
£S5 minimizing symbol error rate," IEEE Trans. Inform. Theory, vol. 
O IT-20, pp. 284-287, March 1974)). The general trend in many 
applications is towards higher data rates and therefore fast 
algorithms and architectures are desired. 

There are two basic performance (speed) aspects of a data 
20 detection circuit architecture. The first is throughput which is 
a measurement of the number of bits per second the architecture 
can decode. The second is latency which is the end-to-end delay 
for decoding a block of N bits. Non-pipelined architectures are 
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those that decode only one block at a time and for which the 
throughput is simply N divided by the latency. Pipelined 
architectures , on the other hand, may decode multiple blocks 
simultaneously, shifted in time, thereby achieving much higher 
5 throughput than their non-pipelined counterparts. 

Depending on the application, the throughput and/or latency 
of the data detection hardware may be important. For example, the 
latency associated with interleaving in a turbo-coded system with 
relatively low data rate (less than lOOKb/s) will likely dominate 
ZfO the latency of the iterative decoding hardware. For future high- 
71 rate systems, however, the latency due to the interleaver may 

become relatively small , making the latency of the decoder 
^ significant. While pipelined decoders can often achieve the 
O throughput requirements, such techniques generally do not 
□5 substantially reduce latency. In addition, sometimes latency has 
O a dramatic impact on overall system performance. For example, in 
a data storage system (e.g., magnetic hard drives), latency in 
the retrieval process has a dramatic impact on the performance of 
the microprocessor and the overall computer. Such magnetic 
20 storage channels may use high-speed Viterbi processing with 
turbo-coded approaches. 

The standard SISO algorithm is the forward-backward 
algorithm. The associated forward and backward recursion steps 
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can be computed in parallel for all of the FSM states at a given 
time, yielding an architecture with 0{N) computational complexity 
and latency, where N is the block size. The key result of this 
paper is the reformulation of the standard SISO computation using 

5 a combination of prefix and suffix operations, which leads to an 
architecture with 0(lg N) latency. This architecture, referred to 
as a ^tree-SISO", is based on a tree-structure for fast parallel 
prefix computations in the Very Large Scale Integration (VLSI) 
literature (e.g., fast adders). 

0 This exponential decrease in latency for the tree-SISO comes 

at the expense of increased computational complexity and area. 
The exact value of these costs depends on the FSM structure 
(e.g., the number of states) and the details of the 
implementation. However, for a four-state convolutional code, 

5 such as those often used as constituent codes in turbo codes, the 
tree-SISO architecture achieves 0(lg N) latency with 
computational complexity of 0{N lg N) . Note that, for this four- 
state example, the computation complexity of tree-SISO 
architecture increases sublinearly with respect to the associated 

0 speed-up. This is better than linear-scale solutions to the 

Viterbi algorithm (e.g., such as described in Fettweis, et al., 
^Parallel Viterbi algorithm implementation: Breaking the ACS- 
bottleneck" IEEE Trans. Commun., vol. 37, pp. 785-790, August 
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1989) ; the generalization of which to the SISO problem is not 
always clear. For this 4-state code example, the area associated 
with the O(lgW) -latency tree-SISO is O(N) . 
Soft-In Soft-Out Modules 

Consider a specific class of finite state machines with no 
parallel state transitions and a generic S-state trellis. Such a 
trellis has up to S transitions departing and entering each 
state. The FSM is defined by the labeling of the state 
transitions by the corresponding FSM input and FSM output. Let t* 
= (s k ,a k , s k +i) = {s k r a*) = is k ,s k+ i) be a trellis transition from 
state sjt at time k to state s k +i in response to input a*. Since 
there are no parallel state transitions, t* is uniquely defined 
by any of these representations. Given that the transition t k 
occurs, the FSM output is x k {t k ) . Note that for generality the 
mapping from transitions to outputs is allowed to be dependent on 
k. 

Consider the FSM as a system that maps a digital input 
sequence a* to a digital output sequence x*. A marginal soft- 
inverse, or SISO, of this FSM can be defined as a mapping of 
soft-in (SI) information on the inputs SI (a*) and outputs SI (x k ) , 
to soft-output (SO) information for a* and/or x*. The mapping is 
defined by the combining and marginalization operators used. It 
is now well-understood that one need only consider one specific 
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reasonable choice for marginalization and combining operators and 
the results easily translate to other operators of interest. 
Thus, the focus is on the min-sum marginalization-combining 
operation with the results translated to max-product , sum- 
product, min*-sum, and max*-sum in a standard fashion. In all 
cases, let the indices Ki and Ki define the time boundaries of 
the combining window or span used in the computation of the soft- 
output for a particular quantity u k {e.g., u k = s k , u k = a kr u k = 
t k , Uk - x kr = {s kf s k+d ), etc.). In general, Ki and K2 are functions 
of k. For notational compactness, this dependency is not 
explicitly denoted. For min-sum marginalization-combining, the 
minimum sequence metric (MSM) of a quantity u k is the metric (or 
length) of the shortest path or sequence in a combining window or 
span that is consistent with the conditional value of u*. 
Specifically, the MSM is defined as follows. As is the standard 
convention, the metric of a transition that cannot occur under 
the FSM structure is interpreted to be infinity. 

MSMj?(ii A ) A jpinA/£(/§), (1) 

l K x u k 

M %(*%) ± Z M HO (2) 

m=K l 

Mm{t m ) A Sl(a m ) + Sl(x m (t m )) , (3) 
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where the set of transitions starting at time Ki and ending at 
time K2 that are consistent with Uk is denoted txi :u k and t*a 
implicitly defines a sequence of transitions t K i, t K i + 1,..., t K 2- 
Depending on the specific application, one or both of the 
following "extrinsic" quantities will be computed 

S<%(*k) £ MSNlgfo) - si(* A ) (4) 

SO%(a k ) A MSMg(^) - sifo) (5) 

Because the system on which the SISO is defined is an FSM, 
the combining and marginalization operations in (2) -(3) can be 
computed efficiently. The traditional approach is the forward- 
backward algorithm which computes the MSM of the states 
recursively forward and backward in time. Specif ically, for the 
standard fixed- interval algorithm based on soft-in for 
transitions tk, k = 0,1,..., N-l, the following recursion based on 
add-compare-select (ACS) operations results: 

f k (s k +l) A MSM*(s,+l) = min[f k -\{ Sk ) + M k {t k )] (6) 

hM A MSMf" 1 ^) = min[^ + l(^+l)+M^)] (7) 

where f-i(so) and b N (s N ) are initialized according to available 
edge information. Note that, since there are S possible values 
for the state, these state metrics can be viewed as (S *1) 
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vectors f k and bk- The final soft-outputs in (4) -(5) are obtained 
by marginalizing over the MSM of the transitions tk 

SO 0 N ~ l (u k ) = mm[f k -\(s k ) + M k (t k ) + b k+1 {s M )] - Sl{u k ) (8) 

l k M k 

where u k is either or a*. The operation in equation (8) is 
5 referred to as a completion operation. 

While the forward-backward algorithm is computationally 
efficient, straightforward implementations of it have large 
latency [i.e., 0(N)) due to ACS bottleneck in computing the 
causal and anticausal state MSMs. 

0 

Prefix and Suffix Operations 

A prefix operation is defined as a generic form of 
computation that takes in n inputs yo, yi,..., y n -i anc * produces n 
outputs zof zi f ... f z n -i according to the following: 
5 zo = yo (9) 

Zi = yo® •» ®yif (10) 
where ® is any associative binary operator. 

Similarly, a suffix operation can be defined as a generic 
form of computation that takes in n inputs yo, yi, y n -i and 
0 produces n outputs zq, zi r ... r z n -i according to 

Z n -1 = yn-l (11) 

z± = yi® - ®yn-i/ (12) 



21 



PATENT 

ATTORNEY DOCKET NO: 06666-077001/USC-3027 

where <g) is any associative binary operator. Notice that a suffix 
operation is simply a (backward) prefix operation anchored at the 
other edge. 

Prefix and suffix operations are important since they enable 
a class of algorithms that can be implemented with low latency 
using tree-structured architectures. The most notable 
realizations of this concept are VLSI N-bit tree adders with 
latency O(lgW) . 

Reformulation of the SISO Operation 

The proposed low-latency architecture is derived by 
formulating the SISO computations in terms of a combination of 
prefix and suffix operations. To obtain this formulation, define 
C{s k ,s m ) , for m > k, as the MSM of state pairs s k and s m based on 
the soft-inputs between them, i.e., C{s k ,s m ) = MSM^" 1 (s k ,s m ) . The 
set of MSMs C{s kr s m ) can be considered an (S * S) matrix C(k,m) . 
The causal state MSMs f^-i can be obtained from C(0,Jt) by 
marginalizing {e.g., minimizing) out the condition on so- The 
backward state metrics can be obtained in a similar fashion. 
Specifically, for each conditional value of s k 

f k -i{s k ) = minC(^ ? ^) (13) 
b k (s k ) = mmC(s k ,s N ) (14) 
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With this observation, one key step of the algorithm is to 
compute C(0,k) and C(k, N) for k = 0, 1,..., N-l. Note that the 
inputs of the algorithm are the one-step transition metrics which 
can be written as C{k, k+1) for k = 0, 1,..., N-l. To show how this 
5 algorithm can be implemented with a prefix and suffix 

computation, a min-sum fusion operator on C matrices is defined 
that inputs two such matrices, one with a left-edge coinciding 
with the right-edge of the other, and marginalizes out the 

H midpoint to obtain a pairwise state-MSM with larger span. 

f|0 Specifically, given C{ko,rci) and C{m,kx), we define a c Fusion 

0| Operator, or (g)c operator is defined by 

OJ c {KA)-C(k^m)® c C{m,k x )^ (15) 

Note that the ® c operator is an associative binary operator 
rt that accepts two matrices and returns one matrix. This is 
■==15 illustrated in Fig. 1. With this definition C{O f k) and C(k, N) 

for k = 0, 1,..., N-l can be computed using the prefix and suffix 

operations as follows: 

C (0, k) = C (0, 1) ® c C (1, 2) ® c ... ® c C ( A - 1, k) 

C {k, N) = C(k,k + 1) ® c ... C(N-2,N-l)® c C(N-l, N) 

20 In general, a SISO algorithm can be based on the decoupling 

property of state-conditioning. Specifically, conditioning on all 
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possible FSM state values at time k, the shortest path problems 
{e.g., MSM computation) on either side of this state condition 
may be solved independently and then fused together {e.g., as 
performed by the c-fusion operator) . More generally, the SISO 
5 operation can be decoupled based on a partition of the 
observation interval with each subinterval processed 
independently and then fused together. For example, the forward- 
backward algorithm is based on a partition to the single- 
transition level with the fusing taking place sequentially in the 
flO forward and backward directions. In contrast, other SISO 
VI algorithms may be defined by specifying the partition and a 
,1 schedule for fusing together the solutions to the sub-problems. 
t=i This may be viewed as specifying an association scheme to the 
O above prefix-suffix operations {i.e., grouping with parentheses). 
OS The C-fusion operations may be simplified in some cases 

O depending on the association scheme. For example, the forward- 
backward algorithm replaces all c-fusion operations by the much 
simpler forward and backward ACSs. However, latency is also a 
function of the association scheme. An architecture based on a 
20 pairwise tree-structured grouping is presented below. This 

structure allows only a small subset of the C-fusion operations 
to be simplified, but facilitates a significant reduction in 
latency compared to the forward-backward algorithm, by fusing 
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solutions to the subproblems in a parallel, instead of 
sequential manner. 

Low-Latency Tree-SISO Architectures 

5 Many low-latency parallel architectures based on binary tree- 
structured groupings of prefix operations can be adopted to SISOs 
such as described in Brent, et al., "A regular layout for 
parallel adders, " IEEE Transactions on Computers, vol. C-31, pp. 
260-264, March 1982; T. H. Cormen, et al., Introduction to 

0 Algorithms. Cambridge, Mass.: The MIT Press, 1990; and A. E. 
Despain, "Chapter 2: Notes on computer architecture for high 
performance," in New Computer Architectures, Academic Press, 
1984. All of these have targeted n-bit adder design where the 
binary associative operator is a simple 1-bit addition. The 

5 present inventors were the first to recognize that parallel 
prefix-suffix architectures could be applied to an algorithm 
based on binary associative operators that are substantially more 
complex than 1-bit addition. Conventional parallel prefix 
architectures trade reduced area for higher latency and account 

0 for a secondary restriction of limited fanout of each 

computational module. This latter restriction is important when 
the computational modules are small and have delay comparable to 
the delay of wires and buffers (e.g., in adder design). The 
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fusion operators, however, are relatively large. Consequently, 
given current VLSI trends, it is believed that they will dominate 
the overall delay for the near future. Thus, an architecture 
described herein minimizes latency with the minimal number of 
5 computational modules without regard to fanout. 

Specifically, the forward and backward metrics, f^-i and bw-jt/ 
for k — 1, 2,..., N can be obtained using a hierarchal tree- 
structure based on the fusion-module (FM) array shown in Fig. 2. 
p A complete set of C matrices on the interval {ko, ko+K} as the 
f|0 2K-1 matrices C{ko, ko+m) and C (£o+m, ko+K) for m = 1,2,..., K-l along 
fh with c {ko, ko+K) . This is the MSM information for all state pairs 
*J on the span of K steps in the trellis with one state being either 
& " on the left or right edge of the interval. The module in Fig. 2 

fuses the complete sets of C matrices for two adjacent span-K 
J : i5 intervals to produce a complete set of C matrices on the combined 
)^ span of size 2K- Of the 4K-1 output c matrices, 2K are obtained 
from the 2(2K-1) inputs without any processing. The other 2 K-l 
output c matrices are obtained by 2K-1 C Fusion Modules, or CFMs, 

which implement the (g)c operator. 
20 The basic span-K to span-2K FM array shown in Fig. 2 can be 

utilized to compute the c matrices on the entire interval in IgN 
stages. This is illustrated in Fig. 3 for the special case of N = 
16. Note that, indexing the stages from left to right (i.e., 
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increasing span) as i = 1, 2,..., n = lqN it is clear that there 
are 2 n ~ 1 FM arrays in stage i. 

Because the final objective is to compute the causal and 
anticausal state metrics, however, not all FM f s need be CFMs for 
5 all FM arrays. Specifically, the forward state metrics f k -i can be 
obtained from f^-i and C{m,k) via 

fkA S k) = ^[fmA S m) + C(s m ,S k )] (16) 

Similarly, the backward state metrics can be updated via 
fi b k (3 k ) = mn[b m (5 m ) + C(s kt s m )] (17) 

t=J m 

f|0 A processing module that produces an f vector from another f 

%~\ vector and a C matrix, as described in equation (16), is referred 
to as an f Fusion Module (fFM) . A b Fusion Module (bFM) is 

H~ defined analogously according to the operation in equation (17) . 

= ; 1 Fig. 3 indicates which FM's may be implemented as fFMs or bFMs. 

35 The importance of this development is that the calculation 

of the state metrics has O(lqN) latency. This is because the only 
data dependencies are from one stage to the next and thus all FM 
arrays within a stage and all FMs within an FM array can be 
executed in parallel, each taking 0(1) latency. The cost of this 

20 low latency is the need for relatively large amounts of area. One 
mitigating factor is that, because the stages of the tree operate 
in sequence, hardware can be shared between stages. Thus, the 
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stage that requires the most hardware dictates the total hardware 
needed. A rough estimate of this is N CFMs, each of which 
involves S 2 S-way ACS units with the associated registers. A more 
detailed analysis that accounts for the use of bFMs and fFMs 

5 whenever possible is set out below in the section heading 

"Hardware Resource Requirements". For the example in Fig. 3 and a 
4-state FSM (i.e., S = 4), stage 2 has the most CFMs (8), but 
stage 3 has the most processing complexity. In particular, the 
complexity of stages i = 1,2,3,4 measured in terms of 4 4-way ACS 

0 units is 26, 36, 32, and 16, respectively. Thus, if hardware is 
shared between stages, a total of 36 sets of 4 4-way ACS units is 
required to execute all FMs in a given stage in parallel. For 
applications when this number of ACS units is prohibitive, one 
can reduce the hardware requirements by as much as a factor of S 

5 with a corresponding linear increase in latency. 

The implementation of the completion operation defined in 
equation (8) should also be considered. The basic operation 
required is a Q-way ACS unit where Q is the number of transitions 
consistent with u k . Assuming that at most half of the transitions 

0 will be consistent with u kr Q is upper bounded by S 2 /2. 

Consequently, when S is large, low-latency, area-efficient 
implementations of the completion step may become an important 
issue. Fortunately, numerous low-latency implementations are 
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well-known (e.g., such as described in P. J. Black, Algorithms 
and Architectures for High Speed Viterbi Decoding. PhD thesis, 
Stanford University, California, March 1993.)- One 
straightforward implementation may be one that uses a binary tree 

5 of comparators and has latency of 0(lqS 2 ) . For small 5, this 
additional latency generally is not significant. 

The computational complexity of the state metric 
calculations can be computed using simple expressions based on 
Figs. 2 and 3. As described below in the section heading 

0 "Computation Complexity Analysis", the total number of 

computations, measured in units of S 5-way ACS computations is 

N S j=N((lgN-3)S + 2) + 4S~2 (18) 

For the example in Fig. 3 and a 4-state FSM, an equivalent 
of 110 sets of 4 4-way ACS operations are performed. This is to 

5 be compared with the corresponding forward-backward algorithm 
which would perform 2N = 32 such operations and have baseline 
architectures with four times the latency. In general, note that 
for a reduction in latency from N to IgN, the computation is 
increased by a factor of roughly (1/2) (IgN -3)S + 1. Thus, while 

0 the associated complexity is high, the complexity scaling is sub- 
linear in N. 



29 



PATENT 

ATTORNEY DOCKET NO: 06666-077001/USC-3027 

Optimizations for Sparse Trellises 

In general, the above architecture is most efficient for 
fully-connected trellises. For sparser trellis structures, 
however, the initial processing modules must process C-matrices 
containing elements set to °o, accounting for MSMs of pairs of 
states between which there is no sequence of transitions, thereby 
wasting processing power and latency. Alternative embodiments may 
incorporate optimizations that address this inefficiency. 

Consider as a baseline a standard 1-step trellis with S - M L 
states and exactly M transitions into and out of each state, in 
which, there exists exactly one sequence of transitions to go 
from a given state at time s k to a given state s k + L . One 
optimization is to pre-collapse the one-step trellis into an in- 
step trellis, 1 < £ < L, and apply the tree-SISO architecture to 
the collapsed trellis. A second optimization is to, wherever 
possible, simplify the C fusion modules. In particular, for a 
SISO on an R-step trellis, the first Ig ( L/ R) stages can be 
simplified to banks of additions that simply add incoming pairs 
of multi-step transition metrics. 

More precisely, pre-collapsing involves adding the R metrics 
of the 1-step transitions that constitute the transition metrics 

of each super-transition tf^ R , for k = 0,1,..., (N-l)/iR. The SISO 
accepts these inputs and produces forward and backward MSMs, f kR - 
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i(s k ) and b( k+ i) R {s {k+ i) R ) , for k = 0, 1,..., N/R. One key benefit of 
pre-collapsing is that the number of SISO inputs is reduced by a 
factor of R, thereby reducing the number of stages required in 
the state metric computation by lgi?. One potential disadvantage 
5 of pre-collapsing is that the desired soft-outputs must be 

computed using a more complex, generalized completion operation. 
Namely, 

SOf >,, + > min 

m Sl{u kR+m ) m = 0, 1, R - 1 (19) 

CiO One principal issue is that for each ujta+m this completion step 
-4 involves an [M L+R /2 ) -way ACS rather than the (M L+1 /2)-way ACS 
s required for the 1-step trellis. 

Hi In order to identify the optimal R (i.e., for minimum 

f*i latency) assuming both these optimizations are performed, the 
fI5 relative latencies of the constituent operations are needed. 

While exact latencies are dependent on implementation details, 
rough estimates may still yield insightful results. In 
particular, assuming that both the pre-collapsing additions and 
ACS operations for the state metric and completion operations are 
20 implemented using binary trees of adders/comparators, and their 

estimated delay is logarithmic in the number of their inputs. One 
important observation is that the pre-collapsing along with lgi? 
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simplified stages together add L 1-step transition metrics 
(producing the transition metrics for a fully-connected L-step 
trellis) and thus can jointly be implemented in an estimated IgL 
time units. In addition, the state metric (#) -way ACS units take 
lgM L time units and the completion units (M L+K /2)-way ACSs take 
lq(M L+R /2) time units. Assuming maximal parallelism, this yields a 
total latency of 

lgL + lg(N/R)lg(M L ) + lg(M L+R /2) (20) 

It follows that the minimum latency occurs when R - L lgR is 
minimum (subject to 1 ^ R < L) , which occurs when R - L. This 
suggests that the minimum-latency architecture is one in which 
the trellis is pre-collapsed into a fully-connected trellis and 
more complex completion units are used to extract the soft 
outputs from the periodic state metrics calculated. 

The cost of this reduced latency is the additional area 
reguired to implement the trees of adders that produce the L-step 
transition metrics and the larger trees of comparators required 
to implement the more complex completion operations. Note, 
however, that this area overhead can be mitigated by sharing 
adders and comparators among stages of each tree and, in some 
cases, between trees with only marginal impact on latency. 
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Use in Tiled Sub-Window Schemes 

The present inventors recognized that using smaller 
combining windows reduces latency and improves throughput of 
computing the soft-inverse. Minimum half-window (MHW) algorithms 
are a class of SISOs in which the combing window edges Ki and K2 
satisfy K\ ^ max(0, k - d) and K2 ^ min(AT, k + d) , for k = 0,..., 
W-l - i.e., for every point k away from the edge of the 
observation window, the soft-output is based on a sub-window with 
left and right edges at least d points from k. 

The traditional forward-backward algorithm can be used on 
sub-windows to obtain a MHW-SISO. One particular scheme is the 
tiled sub-window technique in which combining windows of length 
2d + h are used to derive all state metrics. In this scheme, as 
illustrated in Fig. 4, the windows are tiled with overlap of 

length 2d and there are such windows. The forward-backward 

recursion on each interior sub-window yields h soft outputs, so 
there is an overlap penalty which increases as h decreases. 

For the i th such window, the forward and backward state 
metrics are computed using the recursions, modified from that of 
equations (6) and (7): 

/i'^*+i) = MS1 <(** + i) (21) 
( s k) = MSMf +2rf+/i ~ I (s k ) (22) 

33 



ATTORNEY DOCKET NO: 



PATENT 

06666-077001/USC-3027 



If all windows are processed in parallel, this architecture 

yields a latency of 0(d + h) . 

The tree-SISO algorithm can be used in a MHW scheme without 

any overlap penalty and with O(lgd) latency. Consider N/d 
5 combining windows of size d and let the tree-SISO compute C(id, 

id + j ) and C((i + l)d, (i + l)d - j) for j = 0, d - 1 and i = 

0, N/d - 1- Then, use one additional stage of logic to compute 

the forward and backward state metrics for all k time indices 
q that fall within the i th window, i = 0,..., N/d - 1, as follows 
|J0 (this should be interpreted with C(s-d, so) replaced by initial 

left-edge information and similarly for C(s N -i, SN+d-i) : 




^ The inner minimization corresponds to a conversion from C 

15 information to f (b) information as in equations (13) and (14) . 

The outer minimization corresponds to an fFM or bFM. The order of 
this minimization was chosen to minimize complexity. This is 
reflected in the example of this approach, shown in Fig. 5, where 
the last stage of each of the four tree-SISOs is modified to 
20 execute the above minimizations in the proposed order. The module 
that does this is referred to as a 2Cfb module. This module may 
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be viewed as a specialization of the stage 2 center CFMs in Fig. 
3. The above combining of sub-window tree-SISO outputs adds one 
additional processing stage so that the required number of stages 
of FMs is lg(d) + 1. 

5 

Computational Complexity Comparison 

The computational complexity of computing the state metrics 
using the forward-backward tiled scheme is the number of windows 
p times the complexity of computing the forward-backward algorithm 
jjO on each window. In terms of S S-way ACSs, this can be 
approximated for large N via 

2 2(d + h)*—(d + h) (23) 

ri The computational complexity of computing the state metrics using 
fi s the tree-SISO tiled scheme in terms of S 5-way ACSs can be 
3(5 developed similarly and is 

jdlg(d)S + 2N = N(Slg(d) + 2) (24) 

Determining which scheme has higher computational complexity 
depends on the relative sizes of h and d. If h is reduced, the 
standard forward-backward scheme reduces in latency but increases 
20 in computational complexity because the number of overlapped 

windows increase. Since the tiled tree-SISO architecture has no 
overlap penalty, as h is decreased in a tiled forward-backward 
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scheme, the relative computational complexity trade-off becomes 

more favorable for the tree-SISO approach. In fact, for h < 

the computational complexities of the tree-SISO are lower than 
for the tiled forward-backward scheme. 



A Design Example: 4- state PCCC 

The highly parallel architectures considered require large 
implementation area. In this example, an embodiment is described 
in which the area requirements are most feasible for 
implementation in the near future. Specifically, an iterative 
decoder based on 4-state sparse (one-step) trellises is 
considered. Considering larger S will yield more impressive 
latency reductions for the tree-SISO. This is because the 
latency-reduction obtained by the tree-SISO architecture relative 
to the parallel tiled forward-backward architecture depends on 
the minimum half -window size. One expects that good performance 
requires a value of d that grows with the number of states (i.e., 
similar to the rule-of-thumb for traceback depth in the Viterbi 
algorithm for sparse trellises) . In contrast, considering pre- 
collapsing will yield less impressive latency reductions. For 
example, if d = 16 is required for a single-step trellis, then an 
effective value of d = 8 would suffice for a two-step trellis. 
The latency reduction factor associated with the tree-SISO for 
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the former would be approximately 4, but only 8/3 for the latter. 
However, larger S and/or pre-collapsing yields larger 
implementation area and is not in keeping with our desire to 
realistically assess the near-term feasibility of these 
algorithms . 

In particular, a standard parallel concatenated 
convolutional code (PCCC) with two 4-state constituent codes [1] , 
[2] is considered. Each of the recursive systematic constituent 
codes generates parity using the generator polynomial G{D) = (1 + 
D 2 ) / (1 + D + D 2 ) with parity bits punctured to achieve an overall 
systematic code with rate 1/2. 

In order to determine the appropriate value for d to be used 
in the MHW-SISOs, simulations were performed where each SISO used 
a combining window {k - d, ...Jc + d} to compute the soft-output at 
time k. This is exactly equivalent to the SISO operation obtained 
by a tiled forward-backward approach with h = 1. Note that, since 
d is the size of all (interior) half-windows for the simulations, 
any architecture based on a MHW-SISO with d will perform at least 
as well (e.g., h = 2 tiled forward-backward, d-tiled tree-SISO, 
etc.). Simulation results are shown in Fig. 6 for an interleaver 
size of N = 1024 with min-sum marginalization and combining and 
ten iterations. The performance is shown for various d along with 
the performance of the fixed-interval (N - 1024) SISO. No 
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significant iteration gain is achieved beyond ten iterations for 
any of the configurations. The results indicate that d = 16 
yields performance near the fixed-interval case. This is 
consistent with the rule-of -thumb of five to seven times the 
memory for the traceback depth in a Viterbi decoder (i.e., 
roughly d = 7*2 = 14 is expected to be sufficient) . 

Since the required window size is d = 16, the latency 
improvement of a tree-SISO relative to a tiled forward-backward 
scheme is close to 4 = 16/lg(16). The computational complexity of 
these two approaches is similar and depends on the details of the 
implementation and the choice of h for the tiled forward-backward 
approach. A complete fair comparison generally would require a 
detailed implementation of the two approaches. Below a design for 
the tree-SISO based sub-window architecture is described. 

A factor that impacts the area of the architecture is the 
bit-width of the data units. Simulation results suggest that an 
8-bit datapath is sufficient. Roughly speaking, a tree-based 
architecture for this example would require 1024 sets of sixteen 
4-way ACS units along with associated output registers to store 
intermediate state metric results. Each 4-way ACS unit can be 
implemented with an 8-bit 4-to-l multiplexor, four 8-bit adders, 
six 8-bit comparators, and one 8-bit register. Initial VLSI 
designs indicate that these units require approximately 2250 
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transistors. Thus, this yields an estimate of 16 *2250 x 1024 « 40 
Million transistors. This number or logic transistors pushes the 
limit of current VLSI technology but should soon be feasible. An 
architecture is considered in which one clock cycle is used per 
5 stage of the tree at a 200 MHz clock frequency. For d = 16, each 
SISO operation can be performed in 6 such clock cycles (using one 
clock for the completion step) . Moreover, assume a hard-wired 
interleaver comprising two rows of 1024 registers with an 

0 interconnection network. Such an interleaver would be larger than 
CCO existing memory-based solutions, but could have a latency of 1 

01 clock cycle. Consequently, one iteration of the turbo decoder, 

sj consisting of two applications of the SISO, one interleaving, and 
~" one deinterleaving, requires 14 clock cycles. Assuming ten 
j'S iterations, the decoding of 1024 bits would take 140 clock 
rI5 cycles, or a latency of just 700 ns. 

* 3 f This latency also implies a very high throughput which can 

further be improved with standard pipelining techniques. In 
particular, a non-pipelined implementation has an estimated 
throughput of 1024 bits per 700 ns = 1.5 Gb/second. Using the 

20 tree-SISO architecture one could also pipeline across interleaver 
blocks as described by Masera et al., "VLSI architectures for 
turbo codes," IEEE Transactions on VLSI, vol. 7, September 1999. 
In particular, 20 such tiled tree-SISOs and associated 
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interleavers can be used to achieve a factor of 20 in increased 
throughput , yielding a throughput of 30 Gb/second. 

Moreover, unlike architectures based on the forward-backward 
algorithm, the tree-SISO can easily be internally pipelined, 
yielding even higher throughputs with linear hardware scaling. In 
particular, if dedicated hardware is used for each stage of the 
tree-SISO, pipelining the tree-SISO internally may yield another 
factor of lg(d) in throughput, with no increase in latency. For 
window sizes of d = 16, the tree-based architecture could support 
over 120 Gb/second. That said, it is important to realize that 
with current technology such hardware costs may be beyond 
practical limits. Given the continued increasing densities of 
VLSI technology, however, even such aggressive architectures may 
become cost-effective in the future. 

Computation Complexity Analysis 

The number of required stages is n = lqN r with 2 n ~ 1 FM arrays 
in stage i. Each of these FM arrays in stage i span 2 1 steps in 
the trellis and contains of 2 2 -l FMs. Thus, the total number of 
FMs in stage i is n m {i) = (2 2 -l)2 n_1 . The total number of fusion 
operations is therefore 
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N FM = £«w(0 

i=X 

Y2 n -2 n 2~ l 

i=l 

N(lgN-l) + l (25) 

5 For the example in Fig. 3, this reduces to N m = 49. 

Using Fig. 3 as an example , it can be seen that the number 
of FMs that can be implemented as fFMs in stage i is n f (i) = 2 1 " 1 . 
In the special case of i = n, this is interpreted as replacing 
the 2K-1 CFMs by K fFMs and K bFMs . For example, in the fourth 

0 stage in Fig. 3, the 15 CFMs implied by Fig. 2 may be replaced by 
8 fFMs and 8 bFMs, as shown. The number of FMs that can 
implemented as bFMs is the same - i.e., n b (i) = n f (i) = 2 2 " 1 . It 
follows that the number of CFMs required at stage i is 

nc(0 = w ™(0" w *(0" w /(0 + *( w "0 ( 26 > 

5 = 2 "-2 n - l -2 l + 5 (n-i) (27) 

where 8(j) is the Kronecker delta. The total number of fusion 
modules is therefore 
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i=l i=l 



^f = ^b=Z«f(0 = Z 2W = ^-l (28) 

n 



*=1 

( n \ 
V /=1 J 



+ 1 



= tf(lgtf-3) + 4 (29) 

5 Comparing equations (25) and {29), it is seen that, for 

relatively large N, the fraction of FMs that must be CFMs is (lg 
N - 3)/(lg N - 1) . For smaller N, the fraction is slightly 
larger. For example, in Fig. 3, N± - = 15 and there are 20 
CFMs. 

0 The CFM is approximately S (i.e., the number of states) 

times more complex than the f FM and bFM operations. This can be 
seen by comparing equation (15) with equations (16) and (17) . 
Specifically, the operations in equations (15), (16), and (17) 
involve S-way ACSs. For the CFM, an S-way ACS must be carried out 

5 for every possible state pair (^s k ^,s k ^ in (15) - i.e., S 2 state 

pairs. The S-way ACS operations in equations (16), and (17) need 
only be computed for each of the 5 states s*. Thus, taking the 
basic unit of computation to be S S-way ACS on an S-state 
trellis, the total number of these computations required for 
0 stage i is 
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n sjs (0 = Sn c (0 + Hf (0 + (0 (30) 
Summing over stages, the total number of computations is 
obtained, measured in units of S S-way ACS computations 

N sjs =SN c +2N f =N((lgN-3)S + 2) + 4S-2 (31) 
5 For the example in Fig. 3 and a 4-state FSM, an equivalent of 110 
sets of S S-way ACS operations are performed. This is to be 
compared with the corresponding forward-backward algorithm which 
would perform 2N = 32 such operations and have baseline 
d| architectures with four times the latency. In general, note that 
JE0 the for a reduction in latency from N to lg N, the computation is 
%j increased by a factor of roughly (1/2) (lg N - 3) S + 1. Thus, 
ffi while the associated complexity is high, the complexity scaling 

is sub-linear in N. For small S, this is better than linear-scale 
%l solutions to low-latency Viterbi algorithm implementations 
;;j5 (e.g., such as described in P. J. Black, Algorithms and 
m Architectures for High Speed Viterbi Decoding. PhD thesis, 

Stanford University, California, March 1993; and Fettweis, et 
al., ^Parallel Viterbi algorithm implementation: Breaking the 
ACS-bottleneck" IEEE Trans. Commun., vol. 37, pp. 785-790, August 
20 1989). 
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JO 



15 



Hardware Resource Requirements 

The maximum of n SfS U) over i is of interest because it 
determines the minimum hardware resource requirements to achieve 
the desired minimum latency. This is because the fusion modules 
can be shared between stages with negligible impact on latency. 

The maximum of n s ,s (i) can be found by considering the 
condition on i for which n s ,s (i) > n s ,s - Specifically, if i 

< n, 

"wtO^wO'- 1 ) (32) 
<^2 n >2 2i ~ x (\-S- x ) (33) 

/7 + l-lg(l-^- 1 ) 



(34; 



It follows that n St s(i) has no local maxima and 

w + l-l g (l-yi) 



i = 



(35! 



can be used to find the maximizer of n s ,s(i) • Specifically, if 
equation (35) yields i* < n-1, then the maximum occurs at i*, 
otherwise (i* = n-1) r the i = n-1 and i = n cases should be 
compared to determine the maximum complexity stage. For S > 4, 
equation (35) can be reduced to 

n + l 



i = 



(36) 
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since 0.5< — 4 — ^< 0.71 for S > 4. 

Other Embodiments of a Tree -Structured SISO 

Generally, in implementing a tree-structured SISO, any of 
5 various tree structures can be used that represent a trade-off 
between latency, computational complexity and IC area according 
to the system designer's preferences. Figs. 8A and 8B show an 
embodiment referred to as a Forward-Backward Tree-SISO (FBT- 
SISO) . In the FBT-SISO, the tree structure recursion is bi- 

JEO directional - inward and outward. As a result, the FBT-SISO has 
twice the latency of the Tree-SISO, but it also achieves a 

f=j significant decrease in computational complexity and uses less 

r-s area on an integrated circuit (IC) chip. 

Ill Details of message passing using the generalized forward- 

JS5 backward schedule are shown in FIGS. 8A and 8B in min-sum 
' r ' b ' processing. The inward messages are shown in FIG. 8A. 

Specifically, initially MI [tk] is set to uniform and the 
algorithm begins by activating the first level of subsystems to 
compute Mk[tk] from MI[x(tk)] and MI[a(tk)]. The messages passed 
20 inward to the next level of the tree are MSMk[sk, sk+1] which is 
simply Mk[tk] if there are no parallel transitions. This inward 
message passing continues with the messages shown. When the two 
messages on s4 reach V4-s, the outward propagation begins and 
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proceeds downward as shown in FIG. 8B. Again, all nodes at a 
given level of the tree are activated before activating any of 
the nodes at the next level. At the bottom level, the input 
metric of (sk, sk+1) is MSM{k}c[sk, sk+1] - i.e., the sum of the 
5 forward and backward state metrics in the standard forward- 
backward algorithm. Thus, the final activation of the nodes on 
the bottom level produces the desired extrinsic output metrics. 

This FBT-SISO has twice the latency of the Tree-SISO because 
pi the messages must propagate both inward and outward. This modest 
JlO increase in latency is accompanied by a significant reduction in 
~^ computational complexity. Specifically, the FBT-Tree SISO has 
^ 0(K) computational complexity and 0(log2K) latency. This is to 
=^ be compared to 0(K log2K) computational complexity and 0(log2K) 
O latency for the Tree-SISO and O(K) computational complexity and 
□15 O(K) latency for message passing on the standard trellis. 
O Other embodiments of a tree-structured SISO may be 

advantageous depending on the designer's goals and constraints. 
In general, a tree-structured SISO can be constructed that uses 
virtually any type of tree structure. For example, advantageous 
20 results may be obtained with a tree-structured SISO that uses one 
or more of the tree structures described in R.P. Brent and H.T. 
Kung, "A regular layout for parallel adders," IEEE Transactions 
on Computers, 031:260-264 (March 1982) (the "Brent-Kung tree") ; 
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A.E. Despain, "New Computer Architectures/' Chapter 2: Notes on 
computer architecture for high performance, Academic Press 
(1984); T.H. Cormen, C. Leiserson, and R.L. Rivest, "Introduction 
to Algorithms/' The MIT Press (1990); and/or S.M. Aji and R.J. 
McEliece, "The generalized distributive law/' IEEE Trans. Inform. 
Theory, 4 6 (2 ): 325-343 (March 2000). 

Fig. 9 shows a representation of a Brent-Kung Tree-SISO in 
which calculation of the branch metrics in a d=16 sub-window uses 
a modified version of the Brent-Kung model. There are six 
pipeline stages in the Brent-Kung Tree-SISO which are indicated 
by the dotted lines. Nodes shaded gray represent a 2-way ACS 
while the black nodes represent a 4-way ACS. 

The Brent-Kung Tree-SISO is based on the Brent-Kung parallel 
adder. It was created to solve the fan-out problem of the prefix 
adders. Additionally it reduces the amount of hardware needed for 
the calculation of all the metrics. The fusion operation is also 
used here, but the amount of fusion operations needed is 
significantly reduced. In the Brent-Kung adder, instead of 
additions, fusion operations are performed at each node. In this 
form only the forward information can be calculated. The model 
was modified so that the calculation of both the forward and 
backward metrics could be performed at the same time. 
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This model firstly reduces the number of units that have to 
be driven by the output of an ACS. In the worst case here, 4 
units feed on the output of a single stage (i.e. node C0,8)„ This 
is almost half of what the previous approach needed. It is also 
observed that there is a significant number of operations that 
only need 2-way ACS units. Considering that the 2-way ACS unit 
uses less than half of the hardware needed in a 4-way ACS unit, 
the total size of the circuitry is expected to drop considerably. 
An analysis similar to the one performed before, verifies this 
intuitive assumption. The results are summarized in Fig. 10. 

Advantages presented by this approach may be counterbalanced 
with a reduction in the system's performance. A close look at the 
block diagram in Fig. 10 indicates that the longest path for the 
calculations is now 6 cycles long. Adding the three extra cycles 
needed for the forward and backward metric calculation, the 
completion step and the interleaving process brings the total 
delay of the SISO module to 9 cycles. This means that for the 
whole decoding process takes 180 cycles. Assuming that the same 
cells are used for implementation, this yields a total time of 
540nsec for processing one block of 1024 bits of data. The 
throughput of the system in this case will be 1.8 96Gbps. If the 
unfolded design pipelined after each ACS step is used, that would 
allow one block to be processed after each step, and a throughput 
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of 16.82Gbps could be realized. If 20 SISOs were used to unfold 
the loop, the throughput would be 341.32Gbps. For the first case, 
which is of interest due to the size of the design, the 
performance degradation is only about 24.1%. At the same time the 
5 number of transistors needed to implement this design is reduced 
by almost 43.8%. 

Decoding Block Codes and Concatenated Blocks with the Tree- 
Structure SISO 

f|0 

,jl There are other relevant decoding problems in which the 

conventional solution is to run the standard forward-backward 
n algorithm on a trellis. The methods and techniques described 

herein also can be applied in place of the forward-backward 
^15 algorithm in order to reduce the processing latency in these 
H: applications. One example of such an application is computing 
W the soft inversion of a block error correction code using the 
trellis representation of the code. A method for decoding a 
block code using a trellis representation was described in Robert 
20 J. McEliece, "On the BCJR Trellis for Linear Block Codes," IEEE 
Transactions on Information Theory," vol. 42, No. 4, July 1996. 
In that paper, a method for constructing a trellis representation 
based on the parity-check structure of the code is described. 
Decoding, or more generally soft-inversion of the block code, can 
25 be accomplished by running the forward-backward algorithm on this 
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trellis. The methods and techniques described herein can be 
applied to determine the soft-inversion of a block code in a 
manner similar to the tree-structured methods for soft-inversion 
of an FSM. Specif ically, the forward and backward state metrics 
can be computed to find the soft-inversion of a block code by 
using a parallel prefix computational architecture with tree- 
structure . 

The application of the tree-SISO architecture to 
implementing the soft-inverse of a block code via the parity 
check structure is significant as a practical matter because 
several attractive turbo-like codes are based on the 
concatenation of simple parity check codes. These codes are 
often referred to as "turbo-like codes" since they have similar 
performance and are decoded using iterative algorithms in which 
soft-inverse nodes accept, update and exchange soft-information 
on the coded bits. Specific examples of turbo-like codes 
include: Low-Density Parity Check Codes (LDPCs) also known as 
Gallager codes and product codes (also known as turbo-block 
codes) , which are described in J. Hagenauer, E. Offer, and L. 
Papke, "Iterative decoding of binary block and convolutional 
codes," IEEE Transactions on Information Theory, 42 (2) : 429-445, 
March 1996, and R.G. Gallager, "Low-Density Parity-Check Codes," 
MIT Press, Cambridge, MA, 1963. 



50 



PATENT 

ATTORNEY DOCKET NO: 06666-077001/USC-3027 



As a specific example, the parity check trellis for a 
standard Hamming ( 7 , 4 ) code is shown in Fig. 11. The forward- 
backward algorithm may be run on this trellis with latency on the 
order of 7. Alternatively, a tree-SISO architecture can be used 
5 resulting in the computational structure shown in Fig. 12. As in 
the case of FSM soft-inversion, the tree-structured computation 
yields the same forward and backward state metrics as the 
conventional solution method (i.e., running the standard forward- 
p backward algorithm on a trellis) , but has logarithmic latency 
fio (roughly H the latency in this simple example) . In general, for 
□] a block code with length N, the conventional approach based on 
the forward-backward algorithm will have latency 0(N), whereas 
l* the same computation can be computed using the tree-SISO with 
J 4 ;* latency 0 (lg N) . 

;--55 As a specific example of the use for a tree-structured 

p parity check node SISO such as the one illustrated in Fig. 12, 
consider the iterative decoder for an LDPC, as illustrated in 
Fig. 13. This decoder has two basic types of soft-inverse 
processing nodes: the soft broadcaster nodes and the parity-check 
20 SISO nodes. In one embodiment, the decoder executes by 

activating the soft-broadcaster nodes in parallel, followed by 
permuting the generated soft-information which becomes the input 
to the parity check SISO nodes. These nodes are activated 
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producing updated beliefs on the coded bit values that are passed 
back through the permutation and become the input to the soft- 
broadcaster. This may be viewed as a single iteration. Several 
iterations are required before the decoding procedure is 
complete. As in turbo decoding, the stopping criterion is part 
of the design, with a common choice being a fixed number of 
iterations. The computation shown in Fig. 11 is performed in 
each parity check SISO node in a preferred embodiment. 
Alternatively, the tree-structured architecture can be used for 
the computation at each parity check SISO node. In the most 
common form, the parity check nodes in LDPCs are single-parity 
checks, and therefore have a two-state trellis-representation. 

Conclusion 

Based on the interpretation of the SISO operation in terms 
of parallel prefix/suffix operations, a family of tree-structured 
architectures are described above. Compared to the baseline 
forward-backward algorithm architecture, the tree-SISO 
architecture reduces latency from O(N) to O(lqN) . Alternative 
tree-structured SISOs, such as the FBT-SISO, trade a linear 
increase in latency for substantially lower complexity and area. 

An efficient SISO design generally is not built using a 
single tree-SISO, but rather using tree-SISOs as important 
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components. For example, as described above, many tree-SISOs were 
used to comprise a SISO using tiled sub-windows. Latency in that 
example reduced from linear in the minimum half-window size (d) 
for fully-parallel tiled architectures based on the forward- 
backward algorithm, to logarithmic in d for tiled tree-SISOs. 

In general, potential latency advantages of the tree-SISO 
are clearly most significant for applications requiring large 
combining windows. For most practical designs, this is expected 
when the number of states increases. In the one detailed 4-state 
tiled-window example considered, the latency was reduced by a 
factor of approximately 4, For systems with binary inputs and S 
states, one would expect that d = 8 lg(S) would be sufficient. 
Thus, there is a potential reduction in latency of approximately 
8 lg(S) / lg(8 lg S) which becomes quite significant as S 
increases. However, the major challenge in achieving this 
potential latency improvement is the area required for the 
implementation. In particular, building a high-speed S-way ACS 
unit for large S is the key challenge. Techniques to reduce this 
area requirement without incurring performance degradations 
(e.g., bit-serial architectures) are promising areas of research. 
In fact, facilitating larger S may allow the use of smaller 
interleavers, which alleviates the area requirements and reduces 
latency. 
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Various implementations of the systems and techniques 
described here may be realized in digital electronic circuitry, 
integrated circuitry, specially designed ASICs (application 
specific integrated circuits) or in computer hardware, firmware, 
software, or combinations thereof. 

A number of embodiments of the present invention have been 
described- Nevertheless, it will be understood that various 
modifications may be made without departing from the spirit and 
scope of the invention. Accordingly, other embodiments are within 
the scope of the following claims. 
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